Incremental Active Learning with Bias Reduction

نویسندگان

  • Masashi Sugiyama
  • Hidemitsu Ogawa
چکیده

The problem of designing input signals for optimal generalization in supervised learning is called active learning. In many active learning methods devised so far, the bias of the learning results is assumed to be zero. In this paper, we remove this assumption and propose a new active learning method with the bias reduction. The effectiveness of the proposed method is demonstrated through computer simulations.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Incremental Active Learning in Consideration of Bias

The problem of designing input signals for optimal generalization in supervised learning is called active learning. In many active learning methods devised so far, the sampling location minimizing the variance of the learning results is selected. This implies that the bias of the learning results is assumed to be zero or small enough to be neglected. In this paper, we propose an active learning...

متن کامل

Bias Correction for Regularized Regression and its Application in Learning with Streaming Data

We propose an approach to reduce the bias of ridge regression and regularization kernel network. When applied to a single data set the new algorithms have comparable learning performance with the original ones. When applied to incremental learning with block wise streaming data the new algorithms are more efficient due to bias reduction. Both theoretical characterizations and simulation studies...

متن کامل

Active Bias Testing and Adjustment for Concept Learning

Bias is a fundamental aspect of supervised concept learning. Nevertheless, selecting a good bias prior to learning is difficult. In response to this difficulty, systems have recently been developed that dynamically adjust their bias during incremental learning. These systems, however, are limited in their ability to identify erroneous assumptions about the relationship between the bias and the ...

متن کامل

Active Learning with Partially Labeled Data via Bias Reduction

With active learning the learner participates in the process of selecting instances so as to speed-up convergence to the “best” model. This paper presents a principled method of instance selection based on the recent bias variance decomposition work for a 0-1 loss function. We focus on bias reduction to reduce 0-1 loss by using an approximation to the optimal Bayes classifier to calculate the b...

متن کامل

Active Learning with Scarcely Labeled Data via Bias Variance Reduction

In many occasions in real life, we are faced with the problem of classification of partially labeled data, or semi-supervised learning. We consider the special case of scarcely labeled data or when the labeled data is insufficient, and present a principled method which implements active learning in scarcely labeled data to enhance the performance of the learner. This method is based on the rece...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2000